A Novel Tracking Algorithm Using Thermal and Optical Cameras Fused With mmWave Radar Sensor Data

Tracking of moving objects in pan-tilt-zoom (PTZ) cameras is a critical feature for automated surveillance applications. The PTZ auto tracking function enables the camera to control its electric motor mechanisms adjust course optical sensor field view (FOV) track automatically. In this paper, proposed novel object method based on fusion thermal, and millimeter-wave data implemented. implementation performed pan-tilt setup, which ultimately tracks interest thermal while keeping image resolution same as provides valuable distance measurements target radar readings. offers improvements over conventional by adding an extra layer through additional data, turn surplus information that being tracked. compares favorably with commercially available systems.